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Abstract 

The effect of linear lumping, linear transformation to reduce the 
number of state variables on controllability and observability of linear 
differential equations has been studied. Controllability of the original 
system implies the controllability of the lumped system. Examples 
taken from reaction kinetics illustrate our results. 
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1 Introduction 

Dealing with modeling of real questions the large number of variables is 
generally a problem. To have a model which can easily be treated, one 
possible way is to reduce the number of variables by a method called lumping 
[9]. By controllability of a system we mean that it can be brought from any 
position to any other position in a finite amount of time. On the other hand, 
observability of a system means that we can determine the initial state of 
the system from the knowledge of an input-output pair over a certain period 
of time. 

In this paper we study the effect of linear lumping on such properties of 
the system as controllability and observability and apply the results to com- 
partmental systems. Our main result is that a controllable compartmental 
system remains controllable under lumping. 

2 Basic notions of lumping and control theory 

In this section we collect the basis of the mathematical theory of controllabil- 
ity [21 page 16], observability [21 page 26] and lumping [9, page 1534]. Before 
turning to the formal definitions we mention that controllability means that 
any prescribed concentration can be attained using an appropriate control 
input, observability has the meaning that one can reconstruct the history of 
the process when knowing the present concentration composition. 

Let n, r,p G N, A G R nxn , B G M. nxr , C G W xn and let us investigate: 

x{t) = Ax{t)+Bu{t) (1) 
y(t) = Cx(t) (2) 
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with x(t) in R n as the dependent variable of the linear differential equations 
at time t in R and u(t) in R r denoting the bounded and measurable control 
function and y with values in RP the observation function. 

The fundamental definitions and the Kalman rank conditions below can 
be found in any textbook on linear system theory, e.g. in [2]. 

Definition 1 A linear system with a state-space description given by is 
said to be completely controllable if, starting from any position xq in R n 
at any initial time to, the state vector x can be brought to any other position 
x\ in W 1 in a finite amount of time by some control function u. 

Theorem 1 A linear system described by |2P is completely controllable if 
and only if the n x rn matrix Wab '■= [B \ AB \ ... \ A n ~ 1 B] has rank n. 

Let t ,h eR;t <t x . 

Definition 2 A linear system with the state-space description has 
the observability property on an interval (to,ti), if any input-output pair 
(u(t),y(t)), to < t < t\, uniquely determines the initial state x(t$). Fur- 
thermore (CP _ ([Ip is said to be observable at an initial time to if it has the 
observability property on some interval (to,t±) where t% > to. It is said to 
be completely observable if it is observable at every initial time to- 

Theorem 2 A linear system described by is completely observable 

if and only if the n x pn matrix Vca '■= [C T \ A T C T \ . . . | (yl T ) n_1 C T ] has 
rank n. 

Let us consider 



with v(t) in R p denoting the bounded and measurable control function and 
z{t) in R r the observation function. 

Theorem 3 The linear systems and {3p-|2P respectively described 

above are dual to each other in the sense that (Cp-([IP is completely ob- 
servable if and only if ^) is completely controllable and {ip is completely 
controllable if and only if (T3|), ^ is completely observable [H page 32] . 

Let us introduce a slightly modified notion of lumpability [7, page 1262]. 

Definition 3 Suppose I G N, I < n, and M G R lxn , rank(M) = I. If for all 
solutions x(t) to (CP 



x(t) 
z(t) 



A x{t) + C v{t) 
B T x(t) 



(3) 
(4) 



x{t) := Mx(t) 



(5) 
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obeys a differential equation 

x(t) = Ax(t) + u(t) (6) 

with A G M. lxl , and u(t) := MBu{t) then (CP is said to be exactly 
lumpable to ^ by M . The pair of matrices M and A is sometimes referred 
to as a lumping scheme. 



Remark 1 It can be shown that JT]) is exactly lumpable to © by M if and 
only if there exists A 6 IR' X ', such that AM = MA, so we get the lumping 
scheme consisting of M and A = MAM T (MM T ) ~ 1 0. We note that the 
inverse (MM T y 1 G R lxl exists, since rank(M) = / and M T (MM T )" 1 is a 
generalized inverse of M satisfying MM T (MM T y 1 = I M with I lxi being 
the /-identity matrix. It can be proved that there exists a matrix A such 
that AM = MA if 



M = N 



ft 



where fi (i = 1, . . . , I) are any independent, real eigenvectors of the matrix 
A and the matrix N € M. lxl is nonsingular [1, page 117]. 



3 Fundamentals 

A typical chemical reaction step is written schematically as 

Reactant^ Product. (7) 

The reactant and product are each called a complex, which is a set of ele- 
ments with associated coefficients. The elements that make up complexes 
are called species, and can be anything that participates in a reaction, typ- 
ically a chemical element, a molecule, or an electron. The species that are 
on the left side of the equation are used up, and those on the right are 
created when the reaction step occurs. The coefficient that a species takes 
indicates what proportion of it is created or used in the reaction, and by 
convention it is always a non-negative integer. The goal of chemical reac- 
tion theory is to monitor how the concentration of each species changes over 
time [U page 1539]. The fundamental constituent of a chemical reaction is 
the species, the concentration of which we are interested in monitoring. A 
complex is a sum of species with integer coefficients, and a reaction is a pair 
of complexes with an ordering (to distinguish between products and reac- 
tants). Also a subclass of the class of chemical processes can be modeled as 
compartmental systems [1] , [8] . A compartmental system consists of several 
compartments with more or less homogeneous amounts of material. The 



4 



compartments interact by processes of transport and diffusion. The dynam- 
ics of a compartmental system is derived from mass balance considerations. 
The mathematical theory of compartmental systems is of major importance 
to pharmacokineticists, physiologists [SJ. Sometimes it is useful to reduce a 
model to get a new one with a lower dimension. The technique's name is 
lumping, i.e. reduction of the number of variables by grouping them via a 
linear or nonlinear function. Very often problems in the physical, and social 
sciences can be reduced to problems involving matrices which, due to certain 
constraints, have some special structure [TJ page 132]. 

4 Effect of lumping on controllability and observ- 
ability 

Our main result is expressed in the following statement. 

Theorem 4 Let us assume that {7^ is exactly lumpable to (0|) by M and 
the linear system |ip is completely controllable, then the linear system {6|) 
is also completely controllable. 

Proof. Let ([1]) be completely controllable then according to Theorem Q] we 
know that rank(M^4_e) = n - Furthermore, using the fact that 

AM = MA, A l ~ x M = MA 1 ' 1 

we get 

Wab ■= [MB | AMB | ... | (A) 1 - 1 MB] = M[B \AB\...\ A^B}. 

This implies that ([6]) is completely controllable if and only if the I x rl matrix 

M[B | AB | ... | A l ~ l B] 

has rank I by Theorem [TJ Let us assume that the rank of Wab is less than I, 
then there is a nonzero vector b G M 1 with b T WAB = G W l or equivalently 
b T MB = b 1 AMB = ... = b T (A) l - 1 MB = e M. r . Application of the 
Cay ley-Hamilton Theorem now gives 

(Ay = 71(A)'- 1 + 72 (iy- 2 + . . . + him 

where I; x z represents the I x I unit matrix and 71, ... ,7; are suitable con- 
stants, so b T (A) l MB = G R r . With induction we can derive that b T (A) l+j MB = 
€ W for (j = 1, 2, . . . , n - 1 - I) also, thus 

b T [MB I AMB I ... I (A)'" 1 - 1 MB] = b T M[B \ AB | . . . | A n ~ l B] = G R rn . 

Since rank(M) = I, therefore b T M / OeR" thus we get that the rows of 
matrix Wab = [B \ AB \ . . . \ A n ~ l B\ are linearly dependent, which is a 
contradiction. Consequently matrix Wab has to have full rank and hence 
([6]) is completely controllable. 
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Remark 2 The complete controllability of system ([6]) does not imply the 
complete controllability of system ([I]). Since even if the rank of Wab is U 
the rank of Wab can be less then n. A concrete example will also be given 
below on page [TUJ 

Remark 3 In the case of / = n we get that M is a non-singular n x n 
matrix, thus 

rank(WAB) = rank(M[5 | AB | . . . | A l ~ l B\) = 

= rank([B | AB \ . . . | A n ~ 1 B\) = rank(PFAs)- 

Therefore if ([I]) is completely controllable then ([6]) is also completely con- 
trollable and vice versa. 

Remark 4 Let us assume that ([I]) is exactly lumpable to (|6|) by M then 
([3]) is exactly lumpable to 

£(t) = Ax(t) + MC T v{t) (8) 

by M, where AeR ix! such that MA T = AM, so A = MA T M T (MM T ) ~ 1 . 
If we assume that (pQ), ([2]) is completely observable then ([3]) is completely 
controllable by Theorem [3l so © is also completely controllable by the 
application of Theorem [H 

Remark 5 The complete controllability of system ([8]) does not imply the 
complete observability of system ([l])-©. The controllability matrix of sys- 
tem ([BD is [MC T | AMC T | ... | (AY^MC^] = M[C T | A T C T \ ... \ 
(A T ) l - 1 C T ] where we have used AM = MA 1 ',. . . ,A l ~ l M = M(A T ) l ~ 1 . 
Even if it is of has rank /, the rank of Vqa can be less then n. A concrete 
example will also be given below on page [TTJ 

5 Examples 

In this section we will give examples to illustrate our results. 

Let us consider the following chemical reaction, a special case of a com- 
partmental system (3J page 3]: 

A.\ — > A-2 ^2 — > ^-2 ~^ <*3 ^-3 — > ^2 

where Xi {i = 1,2,3) is the ith chemical component or species and the 
positive real number k is the uniform reaction rate constant. The example 
may be degenerate from the point of view of kinetics, however it may be 
considered as a three stage approximation of diffusion in a tube. We are 
interested in the time evolution of the quantities of chemical components. 
If we assume that the physical circumstances are ideal, i.e. in the given 
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reaction the temperature, the pressure, and the volume of the vessel are 
constant we can build up the mass action- type model of the reaction ([9]): 



x\{i) = — kxi(t) + kx2(t) 

x 2 (i) = kxi(t) - 2kx 2 {t) + kx 3 (t) 

xs(t) = kx 2 {t) - kx 3 (t) 



(10) 



where Xi(t) (i = 1,2,3) is to be interpreted as the concentration of the 
species X{ at time t. Equation (flQl) is said to be the induced kinetic differ- 
ential equation of Q. 

To construct the lumping matrix M we use the following facts: if every 

~ fi ~ 



element of the matrix M = N 



is nonnegative, moreover for every 



row of M there exists an element from that row which is the only nonzero 
element of its column, then the lumped system of the induced kinetic differ- 
ential equation of a reaction is also a induced kinetic differential equation of 
a reaction [5] . 

Using this and the fact that the independent, real eigenvectors of 



A 



-k 
k 




k 
-2k 
k 





k 

-k 



arc 



set 



fl 



M 



[1,1,1], fj = [1,0,-1], / 3 T 



[1,-2,1] 



1 


1 " 




" 1 


1 


1 " 




" 2 


1 


" 


1 


-1 




1 





-1 







1 


2 



in all the examples of this section. In this case the new variables are 



Xl 




"210" 




Xl 




2xi + x 2 


^2 _ 




1 2 




X2 




X 2 + 2x 3 








. X 3 . 





and the lumped system is 



Xl 

x 2 



k„ fc A 

--X1 + -X2 
— Xl Xo 

2 2 



which is the induced kinetic differential equation of the reaction 



A.1 — > A.2 SC% — > SCi. 
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Let us remark that the new variables can be considered as groups of the 
old ones measured together, since they are nonnegative linear combinations 
of the old ones. 

We shall use the notion and properties of an M-matrix below. 

Definition 4 Let re € N. If the matrix A n £ W axn can be expressed in the 
form 



A r . 



(12) 



where s £ 



is a nonnegative, irreducible and symmetric 



max Ah < 1, 
h=l,2,...,n 



matrix with the spectral radius g obeying 

where £ M. are eigenvalues ofT nxn , then A n is an M-matrix. 

Since both the coefficient matrix of the original system and that of the 
lumped one are of the form ()12[) : 



A 



-k 


k 





k - 


-2k 


k 





k 


-k 




' -k 




A = 




k 





-2k 



-2k 



1 
10 
1 



1 
1 



r i i 











l l 

1 I 

2 2 



" 2 

1 1 

2 2 



where k > and g(T^ x s) = max[| \ |, [ 1 |, [ — \ [] = 1, and g(T2 X 2) = max[| 
|, | 1 |] = 1, thus both matrices is an M-matrix. A similar construction can 
be obtained for an even number of species as follows. 

First, let n = AO + 2 (9 = 0,1,...) and let us consider the following 
chemical reaction: 



A.\ — > A.2 A.2 — > <\\ A.2 — > ^13 —* A.2 ... ^-46+1 

then two independent, real eigenvectors of the matrix 



X40+2 — > ^49+1 

(13) 



A 



48+2 



-k 
k 








k 

-2k 
k 








k 
-2k 










-2k 
k 







k 
-k 



arc 



A T = [1, 1, 1, 1, . . . , 1, 1], / 2 T = [-1, 1, 1, -1, ... , -1, 1] 
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so if we take 



M : = 
then we obtain 



1 1 1 

-1 1 1 



1 1 

-1 1 



2 2 
2 2 



2 
2 



Ao 



-k k 
k -k 



and the lumped system is again (jlip . 

Second, let n = 4B (# = 1,2,.. .), then two independent, real eigenvec- 
tors of the matrix A^q are 

fi = [1, 1,1,1,--. ,1, 1], fj = [-1, 1, 1, -1, ... , 1, -1] 
so if we take 



M :-- 



1 1 1 

-1 1 1 



1 1 
1 -1 



2 2 
2 2 



2 
2 



then we get A2 and the lumped system is (llip . We note that A n , n 



AO, or n 
2k > and 



40 + 2 



1,2,.. .), is again of the form (fT2"j) . with s 



r 1 

2 
1 
2 




1 
2 

1 

2 














> 0, 



0-1)7^ 



and Aft = cos( 
177]: and g(T nxn ) =| cos(^) 



h 

On' 



l,2...,n are eigenvalues of T nxn [TJ page 
= 1 is the spectral radius of T nxn , thus A n 



in an M-matrix in this case too. Furthermore, the eigenvalues of A n are 
given by — 2k(l — A/J = — 4fc(sin( ^ fe 2 ^ 7r )) 2 , h = 1, 2 . . . ,n, so they are real 
and negative, and zero, and any independent, real eigenvectors of A n are 



in 



n COS ( 



(2g-l)(r/-l)7r . 
2n 



77 = 2,3. ..,n, q = l,2...,n. 



5.1 Examples of the effect of lumping on controllability 
5.1.1 Controllable original — controllable lumped system 

First, let us consider the differential equation 



d 
~dt 



Xl 




X2 




. X 3 . 





-k 
k 




A; 
-2k 
k 








Xl 




1 










U\ 


k 




X2 


+ 





1 









k 




X3 










1 




U3 
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then 





' 1 








—k 


A: 





2k 2 


-3k 2 k 2 


Wab = [B\AB\ A 2 B] = 





1 





k 


-2k 


A: 


-3k 2 


Qk 2 -3k 2 










1 





k 


-k 


k 2 


-3k 2 2k 2 



This matrix has rank 3, therefore this system is completely controllable. 
The lumped system is 



d_ 

dt 







£ 2 _ 





k k 

'2 2 

k _k 

2 2 



3:i 
X 2 



+ 



2 1 
1 2 



ui 

U3 



So W AB = [MB \ AMB] 



which has rank 2, 



2 1 -A; k 
12 k -k 
therefore in this case the lumped system is also completely controllable in 
accordance with Theorem HJ 



5.1.2 Not controllable original — controllable lumped system 

Second, let us consider the control differential equation 



dt 







X2 




. X 3 _ 





-k k 
k 2/c k 
k -k 



Since in this case the matrix Wab 



XI 




" 1 


1 


" 




Ui 


X2 


+ 


1 










U2 


X3 _ 




_ 1 


-1 


_ 




. n 3 . 


1 


1 





-k 








k 2 


1 




















1 - 


1 





k 








-k 2 







has only rank 2, thus this system is not completely controllable. At the same 
time the lumped system is 



d_ 

lit 



X\ 




. ^2 _ 





k k 1 

2 2 

k _k 
2 2 



X\ 
X% 



2 
-2 



U3 



Therefore Wab 



3 2 -2k 
^ 3 -2 2A; j 
the lumped system is still completely contro 



and this matrix has rank 2, so 
lable in this case. 



5.2 Examples for the effect of lumping on observability 
5.2.1 Observable original — observable lumped system 

First, let us consider the observation system 



d 


Xl 




dt 


X2 






. x 3 _ 





-A: 
k 




A; 
-2k 
k 








Xl 


k 




X2 


k 




X3 



yi 




" 1 


1 


" 









1 


1 



Xl 
X-2 
X3 
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i.e. the observation matrix C 



(A T ) 2 C T] 



So V C a = [C T | A 1 C 



1 1 
1 1 

10 k -k 2 -2k 2 
1 1 -k -k 3k 2 3k 2 
1 A; -2A; 2 -A; 2 
this system is completely observable by Theorem [2j The lumped system 

and MC T 



which has rank 3, hence 



is characterized by A 
So [MC T | AMC T] 



_k 
2 
k 
2 

3 1 



k -\ 

2 
k 
2 

-k 



3 1 
1 3 



k 

13 k —k 
this case the lumped system is completely observable 



by Remark UJ 
which has rank 2, therefore in 



5.2.2 Not observable original — observable lumped system 

Second, let us consider the observation system: 

d 
dt 



XI 




" —k 


A; 


" 




XI 


X2 




k 


-2A; 


k 




X2 


. X 3 . 







k 


-k 




. x 3 _ 



yi 




" 2 


1 


" 









1 


2 



X\ 
X-2 
X3 



i.e. now C 



1 ( 

1 \ 

V C A 



Since in this case the matrix 



2 
1 1 
2 





A: 



A: 




-A: 



A: 2 

-k 2 



-k 2 


k 2 



which has rank only 2, thus this system is not completely observable . At the 



same time the lumped system is A 
Therefore [MC T | AMC T ] = 



and MC 



T 



5 1 
1 5 



5 1 -2k 2k 
15 2k -2k 
rank 2, so the lumped system is completely observab 



and this matrix has 
e in this case. 
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Discussion and outlook 

One of the major questions connected with lumping (with this special tech- 
nique to reduce the number of variables) is: are the qualitative properties of 
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the lumped and of the original system connected? This problem has been 
investigated in a more general setting in ??; here we add a new statement: 
suppose we lump a completely controllable system of n compartment. Then 
the lumped system will also be completely controllable. Previously, [6] in- 
vestigated a similar problem: local observability and local controllability of 
reactions. [3] mainly concentrates on symbolic lumping of compartmental 
systems. 

Possible further topics are: the effect of nonlinear lumping on local con- 
trollability and observability. 
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